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Abstract. We investigate continuity properties of the operators obtained 
by the magnetic Weyl calculus on nilpotent Lie groups, using modulation 
spaces associated with unitary representations of certain infinite-dimensional 
Lie groups. 



1. Introduction 

There are three main themes that occur in the present paper: 

- The theory of locahy convex Lie groups and their representations, recently 
surveyed in |Ne06) . See also [NelOj . 

- The pseudo-differential Weyl calculus that takes into account a magnetic 
field on R", which has been recently developed by techniques of hard anal- 
ysis, with motivation coming from quantum mechanics; some references in 
this connection include (MP04j . jIMPOTj . and jMP09) . 

- The modulation spaces from the time-frequency analysis, which have be- 
come an increasingly useful tool in the classical pseudo-differential calculus 
on M"; see for instance the seminal paper |GH99) . 

It follows by our earlier papers |BB09a) and |BB10a| that the first two of the 
above themes are closely related, in the sense that some of the very basic ideas 
of infinite-dimensional Lie theory prove to be very useful for understanding the 
aforementioned magnetic Weyl calculus as a Weyl quantization of a certain coad- 
joint orbit of a semi-direct product group M = F yi R". Here 7^ is a suitable 
translation-invariant space of smooth functions on R" and the coadjoint orbit is 
associated with a natural unitary representation of M on i^(M"). This representa- 
tion theoretic approach to the magnetic Weyl calculus is further developed in the 
present paper by using the third of the themes mentioned above. Specifically, we 
introduce appropriate versions of modulation spaces and use them for describing 
the continuity properties of the magnetic pseudo-differential operators. 

We recall from [BB09a' that our approach to the magnetic Weyl calculus actually 
allows us to extend the constructions of [ MP04^ from the abelian group (R", to 
any simply connected nilpotent Lie group, and this will also be the setting of some 
of the main results of the present paper. However, the proofs are greatly helped 
by a more general framework that we develop, in the first sections of the paper, 
for the so-called localized Weyl calculus for representations of locally convex Lie 
groups that satisfy suitable smoothness conditions. In order to develop this abstract 
setting we provide infinite-dimensional extensions of some ideas and constructions 
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related to irreducible representations of finite-dimensional nilpotent Lie groups, 
which we had developed in jBBOQcj (see also |BB09b| ). These extensions may also 
be interesting on their own, however their importance consists in pointing out that 
the magnetic Weyl calculus of [MP04 and the Weyl-Pedersen calculus initiated in 
[Pe94j are merely different shapes of the same phenomenon. 

The structure of the paper can be seen form the following table of contents: 

§1. Introduction. 

§2. Smooth unitary representations of locally convex Lie groups. 

§3. Localized Weyl calculus and modulation spaces. 

§4. Applications to the magnetic Weyl calculus. 

The aim of sections 2 and 3 is to give general conditions on representations of 
locally convex Lie groups that ensure good properties of a Weyl calculus and related 
objects, as Wigner distributions and modulation spaces. In fact, in this way we set 
up a rather general procedure for proving continuity of the operators obtained by 
the Weyl calculus, and of the Weyl calculus itself. A special case of this procedure, 
that motivated the present paper, appeared in our earlier work |BB09cj on Weyl- 
Pedersen calculus for irreducible representations of finite-dimensional nilpotent Lie 
groups. The developments in this paper allow us to treat the magnetic Weyl calculus 
as a particular case. In Section 4 we show that the conditions in sections 2 and 3 
are met in this case, and continuity/trace-class results are thus derived. 

Notation. Throughout the paper we denote by S{V) the Schwartz space on a 
finite-dimensional real vector space V. That is, S{V) is the set of all smooth func- 
tions that decay faster than any polynomial together with their partial derivatives 
of arbitrary order. Its topological dual — the space of tempered distributions on 
V — is denoted by S'{V). We use the notation C^i(V) for the space of smooth func- 
tions that grow polynomially together with their partial derivatives of arbitrary 
order; the natural locally convex topology of this function space along with some 
of its special properties are discussed in |Ro75j . 

For every complex vector space y we denote by y the complex vector space 
defined by the conditions that y and y have the same underlying real vector space, 
and the identity mapping y ^ y is antilinear. If 3^ is a topological vector space, 
then y will always denote the weak topological dual of y, that is, the space of con- 
tinuous linear functionals on y endowed with the topology of uniform convergence 
on the compact subsets. 

We shall always denote by -ig)- the completed projective tensor product of lo- 
cally convex spaces and by -(g)- the natural tensor product of Hilbert spaces. Our 
references for topological tensor products are |Do74) , |Sch66] , and [Tr67| . 

We shall also use the convention that the Lie groups are denoted by upper case 
Latin letters and the Lie algebras are denoted by the corresponding lower case 
Gothic letters. 



2. Smooth unitary representations of locally convex Lie groups 
Let M be a locally convex Lie group with a smooth exponential mapping 

expjyj : L(M) = m ^ M 
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(see |Ne06| ) . Assume that tt: Af ^ B{T-L) is a unitary representation. We denote 
by Hoo the space of smooth vectors for the representation tt, that is, 

Hoo {0 e H I TT{-)(j} e C°°(Af,H)}. 

We note that Tr{M)Hoo — 'Hoc and, as proved in |Ne01[ Sect. IV], the derived 
representation dyr: m — > End (T^oo) is weU defined and is given by 

(VX G m)(V(/. e Hoo) dT:{X)q^ = ^|^_^^(expj,,(tX))0. 

Remark 2.1. If we denote by U(mc) the universal enveloping algebra of the com- 
plexified Lie algebra mc , then the homomorphism of Lie algebras d7r extends to a 
unique homomorphism of unital associative algebras d7r: U(mc) — ^ End (T^oo)- The 
space of smooth vectors "Hoc will always be considered endowed with the locally 
convex topology defined by the family of seminorms {pu}uev{mc}j where for every 
u G U(tnc) we define 

Hoc ^ [0,oo), = ||d7r(u)0||. 

The inclusion mapping T^oo ^ 'H is continuous and, for all u G U(mc) and m G Af , 
the linear operators d7r(M) : Hoo T~ioa and 7r(m) : 'Hoo Hoo are continuous as 
well. □ 

Definition 2.2. Assume the above setting. 

If the linear subspace of smooth vectors Hoo is dense in H, then the unitary 
representation tt: Af — >■ B{H) is said to be smooth. If this is the case, then tt is 
necessarily continuous, in the sense that the group action M x H ^ H, (m, /) ^ 
Tr{m)f, is continuous. 

The representation tt is said to be nuclearly smooth if the following conditions 
are satisfied: 

(1) TT is a smooth representation; 

(2) Hoo is a nuclear Frechet space; 

(3) both mappings M x Hoo — > Hoo, (™, '/') >^ '^{'m-)(f>, and m x Hoo — > Hoo, 
{X, (f>) d7r(X)0 are continuous. 

Let B{H)oo be the space of smooth vectors for the unitary representation 

TT® 7f: A// X Af B{<B2{H)), (tt 7f)(mi, m2)T 7r(TOi)T7r(TO2)"^ 

We shall say that the representation tt: Af — > B{H) is twice nuclearly smooth if 
it satisfies the following conditions: 

(1) The representation tt is nuclearly smooth. 

(2) There exists the commutative diagram 

Hoo®HZ'^ ^H®H (2.1) 



B[H).oo^ 62{H) 

where the vertical arrow on the left is a linear topological isomorphism, 
while the vertical arrow on the right is the natural unitary operator defined 
by the condition (</)i, 02) i-> 0i 02 := (• | 4>2)4'i- 

□ 
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Remark 2.3. Note that there can exist at most one Frechet topology on Hoo such 
that the inclusion Hoo ^ H he continuous, as a direct consequence of the closed 
graph theorem. □ 

Remark 2.4. Let tt be a smooth representation and denote by H-oo the strong 
dual of 'Hoc- Equivalently, Ti-oo can be described as the space of continuous an- 
tilinear functionals on Hoo endowed with the topology of uniform convergence on 
the bounded subsets of Hoo ■ Then there exist the dense embeddings 

— OO ; 

and the duality pairing (• | •) ■ T^-oo xHoo C extends the scalar product of H. □ 

Proposition 2.5. // the unitary representation tt: Af — > B{'H) is twice nuclearly 
smooth, then it also has the following properties: 

(1) The representation tt (g) tt : M x Af — > B{&2{'H)) is nuclearly smooth. 

(2) We have C{'H-oo,T~l-oo) — ■B(H)oo ^ and there exists the commuta- 
tive diagram 



ei(H)'C ^£(7^-00, Hoc)' 

where the vertical arrow on the left is the natural linear topological isomor- 
phism defined by the trace duality, and the vertical arrow on the right is 
also a linear topological isomorphism. 

Proof. ([T]) The representation tt is twice nuclearly smooth, hence Hoo is a nuclear 
Frechet space and 'Hoa®'Hoo — B{7i)oo- Then B{H)ao is in turn a nuclear Frechet 
space (see for instance |Tr67[ Prop. 50.1 and Prop. 50.6]). Moreover, since T-Loo is 
dense in 'H, it follows that B{T-L)oo is dense in (52(H). To complete the proof of the 
fact that TT 7f is twice nuclearly smooth, we still have to check that the mappings 

M xM X BiH)oc B{H)oo, (mi,m2,T) ^ 7r(mi)r7r(m2)"^ 

and 



m X m X S(H)oo ^ i3(H)oo, iXi,X2,T) ^ d7r(Xi)T - rd^(X 
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are continuous. To this end use again the fact that 'Hao®'Hoo — B{'H)oo and both 
mappings MxHoc Hoo, (w, <f>) 7''("i)(/), and mx Hoo — > Hoc, {X, (j)) ^ A'k{X)4> 
are continuous. 

^ Since Hoo is a nuclear Frechet space, we get 

■£(H_oo, Hoo) = •^(Hoo 5 Hoo) — Hoo®Hoo — B{'H)oa 

(see [TV671 Eq. (50.17)]). 

Moreover, for every T G B{'H)oo we have TH C Hoo- Therefore one can prove (as 
in |BB10bl Th. 3.3], for instance) that S(H)oo Q ©i(H). Moreover, by considering 
the duals of the above topological linear isomorphisms, we get 

■£(H_ooj Hoo)' — (Hoo®Hoo)' — •^(Hoo, Hoo ) — •C(Hoo, H-oo) 

(see [Tr67|, Eqs. (50.19) and (50.16)]), and these isomorphisms agree with the iso- 
morphism (3i(H)' ~ B{H) in the sense of the commutative diagram in the state- 
ment. □ 
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Remark 2.6. For every /i,/2 G "H we denote by fi ® f2 £ B{T-L) the rank-one 
operator / i— > (/ | /2)/i- If the representation tt tt is twice nuclearly smooth, 
then for any /i,/2 G H_oo we can use Proposition 12.51 to define the continuous 
antihnear functional /i ® : B{'H)oo ^ C by (/i (g) /2)(T) = (/i | T/s) for every 
T^B{H)oo- □ 

Group square. 

Definition 2.7. The group square of M, denoted by M k M , is the semi-direct 
product defined by the action of M on itself by inner automorphisms. That is, 
M K M is a locally convex Lie group whose underlying manifold is M x M and the 
group operation is 

(mi, TO2)(ni, ^2) = (mini, nj"^TO2nin2) 
for all TOi, m2, rti, 712 G D 
Lemma 2.8. The following assertions hold: 

(1) The mapping 

fi: M tK M M X M, (mi,m2) 1-^ {mim2,mi) 
is an isomorphism of Lie groups with tangent map 

L(^): m X m X m, {X,Y) ^ {X + Y,X). 

(2) The Lie group M k M has a smooth exponential map 

(^^Pm^m : m X m ^ M X M, (X^Y) ^ (exp^^ X, expj^,ii~X) expA/(X -I- Y)). 
Proof. The arguments of Ex. 2.3 in |BB09c| carry over to the present setting. □ 

Definition 2.9. We introduce the continuous unitary representation 

tt"" : M X M B{&2{n)), tt'^ {mi , m2)T = 7r(miTO2)T7r(mi)~\ 

To see that tt'^ is a representation, one can use a direct computation or the fact 
that so is TT (g) 7f and we have 

TT^ = (7r«)7f) o ^, (2.2) 

where jj.: M x M ^ M x M is the group isomorphism of Lemma 12.81 □ 

3. Localized Weyl calculus and modulation spaces 

The localized Weyl calculus (see Definition l3.10l below) was introduced in [BB09a| 
as a tool for dealing with the magnetic Weyl calculus on nilpotent Lie groups. In 
the present section section we further develop that circle of ideas by introducing 
the modulation spaces and extending some related techniques of |BB09c| to the 
general framework provided by the localized Weyl calculus for representations of 
infinite-dimensional Lie groups. 

Here we single out fairly general conditions that allow for a Weyl calculus to 
be defined, modulation spaces to be considered and continuity properties in these 
spaces to hold. All of these conditions are satisfied in at least two important 
situations: the Weyl-Pedersen calculus for irreducible representations of finite di- 
mensional nilpotent Lie groups (see |BB09c] ) and the magnetic Weyl calculus of 
[BB09a| to be treated in the last section. 
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Ambiguity functions and Wigner distributions. 

Setting 3.1. Throughout this section we keep the fonowing notation: 

(1) A/ is a locally convex Lie group (see |Ne06j ) with a smooth exponential 
mapping exp^ : L(M) = m ^ M. 

(2) tt: M B{%) is a nuclearly smooth unitary representation. 

(3) S and S* are real finite-dimensional vector spaces with a duality pairing 
(•, •) : S* X 5 — M and with Lebesgue measures on 5 and S* suitably 
normalized for the Fourier transform 

^: ^ L°°{E*), &(•) ^ &(•) = J e-'<-'^>6(a;) dx 

to give a unitary operator The inverse of this transform 

will be denoted by a i— a. 

□ 

Definition 3.2. Let 9: S — m be a linear mapping. 

(a) Orthogonality relations. If either ip G Hoc and / G H-oo, or (j), f £ H, then 
we define the ambiguity function along the mapping 0, 

A;''f: E^C, {A^m = (/ I ^(exp,,(0(.)))0). 

Note that this is a continuous function on S. We say that the representation tt 
satisfies the orthogonality relations along the mapping 9 if 

/i I /2)l^(H) = (/l I /2)« • (02 I 4>i)n (3.1) 

for arbitrary (pi, (j>2, fi, f2 G H. In particular, A^'^ f G -Zj^(S) for all (j), f €71. 

(b) Modulation spaces. Consider any direct sum decomposition S = Si -i-S2 and 
r, s G [1, oo]. For arbitrary / G H-oo define 

ll/IUf;-'(.,e) = (/(/ l(^;''/)(^i,^2)rd^i)'^^'"dX2)'^' G [0,00] 

B2 Hi 

with the usual conventions if r or s is infinite. The space 

M;-''i7r,9) := {/ G H-oo \ II/IIm-(.,9) < ^} 

is called a modulation space for the unitary representation tt: M — > B{T-l) with 
respect to the linear mapping 0: S -t- m, the decomposition S ~ Si x S2, and the 
window vector cp G "Hoc \ {0}. □ 

In connection with the above definition, we note that more general "co-orbit 
spaces" A'0(7r, 9) can be defined in by using any Banach space X of functions 

on S instead of the mixed- norm Lebesgue spaces L'''''(Si x S2). More specifically, 
one can define for any window vector (p G T^oo, 

X^{t^,0) ^ {f £n^^\ Al'" f e X}. 

A systematic investigation of these spaces can be done in a broader context (see 
[BBlOcj ). However, the modulation spaces M^''^{n,9) introduced in Definition 13.21 
above will suffice for the purposes of the present paper. See |FG88| . |FG89a| . and 
[FG89b| for these constructions in the case of representations of locally compact 
groups. 
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Remark 3.3. If the representation tt satisfies the orthogonality relations along the 
linear mapping 6: S — > m, then for any decomposition S = Si + S2 and any choice 
of the window vector cj) G Hoo \ {0}, we have M^'^(7r, 9) = %. □ 

Remark 3.4. Let V : T-L ^ Hi be a unitary operator and consider the unitary 
representation tti : M — > B{Hi) such that ViT{m) = ■ni{m)V for every m G M. 
Denote by ^1,00 the space of smooth vectors for tti and let Hi^-oa be the strong dual 
of V-i.oo- Then there exist the linear topological isomorphisms V\-h^ ■ Hoc Hi^oo 
and V-^: H-oo Ui-oo, where V-oof = f o V*\ni_^ for every / e U-oo- It is 
easy to check that for every linear mapping 6* : S — >■ m and arbitrary cj) S T^oo and 
/ G 'H-oo we have A^'^ f = A^^^ (V-oof)- Therefore V-00 naturally gives rise to 
isometric isomorphisms from the modulation spaces of the representation tt onto 
the corresponding modulation spaces of the representation tti . □ 

Definition 3.5. Growth condition. We say that the representation tt satisfies the 
growth condition along the linear mapping 6: S — 5- m if 

Alf^i G S{E), for aU ^1,^2 e Ho. (3.2) 

Note that p.2p implies that the sesquilinear map 

is separately continuous as a straightforward application of the closed graph theo- 
rem, and then it is jointly continuous by |Sch66[ Cor. 1 to Th. 5.1 in Ch. III]. 

If the representation tt satisfies the orthogonality relations along the mapping 0, 
and (/), / G H, then A"^'^ f G hence we can define the cross-Wigner distribu- 

tion yV(/, 0) G L2(S*) by the condition W(J^) := A^^/f. □ 

Definition 3.6. Density condition. The representation n is said to satisfy the 
density condition along the linear mapping 0: S — > m if {A^'^ f | 0, / G H} is a 
total subset of L'^(E), in the sense that it spans a dense linear subspace. □ 

Remark 3.7. If the representation tt satisfies the orthogonality relations along 9, 
then it follows in particular that {A^'^ f \ (j), f G %} C L^(E!), however it is not 
clear in general that this subset of is total. Similarly, if tt satisfies the growth 

condition along 9, then {A^'^ f \ (f>, f G H-oo} Q C however in this way 

we may not get a total subset of □ 

Lemma 3.8. // the representation tt satisfies the orthogonality relations along the 
linear mapping 9: S m, then the following assertions hold: 

(1) The representation 7rCS)7f satisfies the orthogonality relations along the linear 
mapping 6x9: ExE~>mxm. 

(2) The representation tt'^ satisfies the orthogonality relations along each of the 
linear mappings L(/i)^^ o[9x9): SxS^mKm and 9x9: SxS-^mKm. 

Proof. To see that Assertion ([T]) holds, first prove the orthogonality relations for 
rank-one operators in &2{'H), then extend them by sesquilinearity to the finite-rank 
operators, and eventually extend them by continuity to arbitrary Hilbert-Schmidt 
operators. Then Assertion ^ on L(/i) o{9 x 9) follows by Assertion along with 
equation (|2.2p . 
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Then, to see that also the representation tt^ satisfies the orthogonaUty relations 
along 0x6':SxS^mKTn, just note that 

{Lifiy^ o {6 X 9)){x, Y) - {e{Y),e{x) - e{Y)) = {ex 9){y, x-y) 

and the linear mapping S x S — ^ S x S, {X,Y) {Y,X — Y), has the Jacobian 
identically equal to 1. □ 

Lemma 3.9. // the representation tt satisfies the growth condition along the linear 
mapping 9: S — > m, then the following assertions hold: 

(1) The representation tt (g) 7f satisfies the growth condition along the linear 
mapping 9x9: SxS— i-mxm. 

(2) The representation tt"^ satisfies the growth condition along each of the linear 
mappings h{ij.)^^ o [9 x 9) : E x E ^ m x m and 6'x6':SxS— >mKm. 

Proof. The growth condition for the representation tt along 9 implies that the bi- 
linear map A^'^ : Hoo x Hoc is continuous, hence extends to a continuous 
linear map 

By complex conjugation we also have 



Thus we get the continuous mapping 



_4^,eg_4^,e. ^^g^^g^^g^^ s{E)§)S{E) = S{E x E). 

By composing this with the permutation (/i, (pi, fi, (p^) ^ (/i, fi, 0i, <i>'i) and using 
that ?^oo€5'Hoo — B{'H)oD, we get a continuous operator B{'H)oo®B{'H.)oo 5(SxS) 
which extends yl'r®7r,exe sij^^e 



The second part in the growth condition can be checked similarly, by using that 
T-L-oo is nuclear, like T-Lao (see [Sch66[ Ch.IV, Th. 9.6]), and noting the isomorphisms 

u_ocmCZ ^ (n^®Hoo)' ^ B{n)J. 

Assertion ^ on L(/i) o[9x9) follows by Assertion ([1]) along with equation (|2.2p . 
Then, to see that also the representation tt^ satisfies the growth condition along 
9x9: SxS— j-mxtn, just note that 

(L(/.)-i o {9 X 9)){X, Y) - {9{Y), 9{X) - 9{Y)) = {9 x 9){Y, X-Y) 

and the linear mapping S x S — > S x S, {X, Y) {Y,X — Y), is invertible. □ 

Localized Weyl calculus and its continuity properties. 

Definition 3.10. Let 6*: S — >■ m be a linear mapping. 

The localized Weyl calculus for tt along 9 is the mapping Op^ : — > B(l-L) 
given by 

Op^(a) = I a{X)TT{expM{9{X)))dX (3.3) 



for a G -Zj^(^) where we use weakly convergent integrals. 

The localized Weyl calculus for tt along 9 is said to be regular if 
• TT satisfies the growth condition along the mapping 9, 
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• TT is twice nuclearly smooth, and 

• Op^(a) e B{n)oo whenever a G S{E*). 

Note that the closed graph theorem then imphes that Op^ : 5(5*) — > B{'H)oc is a 
continuous hnear mapping. □ 

If the representation tt satisfies the growth condition along the mapping 9, then 
one can think of (|3.3p in the distributional sense in order to define the localized 
Weyl calculus Op'' : S'{E*) CiUocH-oo)- More specifically, for every a e S'{E*) 
and 0, V' G 



(Op''(a)0|V) = (a,^;'» (3.4) 
where (•, •) : S'{E) x 5(S) — > C is the usual duality pairing. 

Remark 3.11. If the localized Weyl calculus for tt along 6 is regular and more- 
over defines a linear topological isomorphism Op^ : iS(S*) — B(l-L)oa (see Proposi- 
tion [3321 for sufficient conditions), then we also have the linear topological isomor- 
phism Op^ S'{E*) C{noo,'H-oo) by Proposition [13111]) . Therefore, by using 
Remark 12.61 we see that there exist the sesquilinear mappings 



A^^'^: H-oo X H-oc^S'{E) and W: U-oo x H-oo^S'{E*) (3.5) 

such that 

Op'(W(/i,/2))=/l®/2 

and W(/i,/2) — A^f fi for all /i,/2 G H_oo- In addition, it follows by p.4|) and 
the definition of the Fourier transform for tempered distributions that for every 
a G iS'(S*) and V' G ^oo we have 

iOp%a)<f>\ib) = ia\W{^,^)). (3.6) 

If moreover the representation tt satisfies the orthogonality relations along the lin- 
ear mapping 9, then it follows by Proposiion 13.121 below that the mappings p.Sp 
agree with the ambiguity functions and the cross- Wigner distributions (see Defini- 
tion [33. □ 



Proposition 3.12. If tt satisfies the orthogonality relations along the linear map- 
ping 9: S ^ m, then the following assertions are equivalent: 

(1) The representation tt satisfies the density condition along 9. 

(2) There exists a unique unitary operator Op^ : L^(S*) &2{'H) which agrees 
with the localized Weyl calculus for tt along 9. 

If these assertions hold true, then we have 

(V/,0gH) Op'>iW{fA))^f^l (3.7) 
// moreover the localized Weyl calculus for tt along 9 is regular, then the mapping 
Op^ : 5(S*) B{T-L)oo is a linear topological isomorphism. 

Proof. We begin with some general remarks. Since we have a unitary Fourier 
transform i^(S) — s- L'^(S*), it follows by the orthogonality relations along with (13. 4p 
that for arbitrary /, G H we have 

Op^W(/, 0)) = / and ||W(/, 0)|U2(H.) = 11/11 • m = 11/ ® 0||e,(w). (3.8) 

Moreover, 

span({/ (g) <^ I /, G -H}) is dense in ©2(H). (3.9) 
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We now come back to the proof. 

" 0=^(12])" Let TT satisfy the density condition along 9. Since the Fourier trans- 
form L2(S) L2(S*) is unitary, it foUows that span({yV'(/, 0) \ f,4> ^ %}) is a 
dense hnear subspace of _L2(S*). Therefore, by using p.Sp and (|3.9I) . we see that 
Op^ uniquely extends to a unitary operator ^^(S*) — ^ &2{T~i). 

"([2])=>(IT])" If the operator Op*' : L2(S*) &2{'H) is unitary, then it follows by 
(|3^ and (|3Jl) that span({>V(/, </>) | /, e H}) is a dense linear subspace of L'^{S*). 
Then, by using again the fact that the Fourier transform ^^(S) ^^(S*) is unitary, 
we can see that span({^^' f \ f,(j) G H}) is a dense linear subspace of L'^{E), that 
is, TT satisfies the density condition along 9. 

Now assume that the assertions ([TJ and ([2]) in the statement are satisfied and 
the localized Weyl calculus for tt along 9 is regular. Then tt satisfies the growth 
condition along 9, hence the ambiguity function defines a continuous sesquilinear 
mapping A^'^ : Tioo x Hoc (see Definition 13. Sp . Since the Fourier transform 

is a linear topological isomorphism S{E) -> the cross- Wigner distributions 

also define a continuous sesquilinear mapping W: Jioo x Hoc which fur- 

ther induces a continuous linear mapping W: "Hoo^^oo 5(S*). On the other 
hand, the condition that the localized Weyl calculus for tt along 9 is regular (see 
Definition l3.10|) includes the assumption that the representation tt is twice nuclearly 
smooth, hence we have a topological linear isomorphism 'Hoo'^'Hoo — B{T-L)oo- 

We thus eventually get a continuous hnear mapping W: B{'H)oo S{E*) which, 
by (|3^ . has the property Op^ o W = id on B{'H)oo- In other words, W = 
(Op")"^ IbCH)oo- Thus the unitary operator Op^ : ^^(S*) 62(H) restricts to 
a continuous linear map tS(S*) — > B{'H)oo (since the localized Weyl calculus for 
TT along 9 is regular), while its inverse (Op )^^ restricts to a continuous linear 
map W: B{'H)oo ^(S*). It then follows that Op^ 5(S*) B(H)oo is a linear 
topological isomorphism (whose inverse is W). □ 

Definition 3.13. Assume that the localized Weyl calculus for tt along the linear 
mapping : S — > m is regular and the representation tt satisfies both the density 
condition and the orthogonality relations along 9. It follows by Proposition 13.121 
that the localized Weyl calculus Op^ defines a unitary operator L'^{E*) — > ©2(H), 
and also linear topological isomorphisms S{E*) B{'H)oo — 'C('H_oo, 'Hoc) and 
iS'(S*) — !> C{T-Loo,T~i-oo)- Hence we can introduce the following notions: 

(1) If a, 6 G tS'(S*) and there exists the well-defined the operator product 



0p*(a)0p^(6) e /:(Hoo,'H_oo), then Remark IXTTl shows that the Moyal 
product a^^b S iS'(S*) is uniquely determined by the condition 



Thus the Moyal product defines bilinear mappings S{^*) x S{E*) — > iS(^*) 
and L2(S*) X L^{E*) ^ L^{E*). 
(2) We define the unitary representation tt* : M k M — ;> B{L'^{E*)) such that 
for every m G M tK M there exists the commutative diagram 



Op''(a#''6) = Op'' (a) Op" (6). 




Op' 



a 



Op' 



62(H) 



©2(H) 
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These constructions provide extensions of some notions introduced in jBB09c| . □ 

Remark 3.14. In the setting of Definition 13.131 we note the fohowing facts: 

(1) For every mi,TO2 G M and / G we have 

^#(mi,m2)/ = (Op^)-i(7r(miTO2))#'/#'(Op'')"H^(™i))-^ 

(2) For every Xi^X^ G S we have Op^(e'< ''^^>) = 7r(expj,,f (6l(Xj))) for j = 1, 2, 
whence by Lemnia r2.8l| 2|) 

= 7r#(expM(^^(Xl)),expJ,,,(-0(Xl))expM(^(Xl +X2)))/ 

whenever / e L^(S*). 

□ 

Proposition 3.15. Assume that the representation n is twice nuclearly smooth. If 
we have either (j)i,(j)2, /i, /2 G H, or 0i, 02 G Hoo and fi, f2 G H-oo, then 

(vx, Y e s) (^;;^7/(/i ® /2))(x, y) = iAlfh)ix + Y) ■ (^;f/2)(x). 

// moreover the localized Weyl calculus for ir along 9 is regular and the representa- 
tion TT satisfies both the density condition and the orthogonality relations along 0, 
then 

(vx,r e s) {A^*^l^l^{w{f,j2mx,Y) = {Al'j,){X + Y)-{Al^^f2){X). 

Proof. It follows at once by definition that 

® ^2) = A^^ fi A^i /2. 
On the other hand, we easily get by (12.21) 

(vx, Y e s) (^;;^7;(/i S5 f2))ix, Y) = (^;f;/^"^/i ® f2)){x + r, X). 

For the second part of the statement, just recah that Op^(W(/i, /2)) — /i 0/2 and 
use Proposition 13.121 along with Remark 13.41 □ 

The next theorem extends a result in |BB09c) , and the general lines of the proof 
go back to [TC04] . 

Theorem 3.16. Let 4>i,(j}2 G "Hoc \ {0}, and assume the following hypotheses: 

(1) The representation tt satisfies both the density condition and the orthogo- 
nality relations along the linear mapping 6: S — > m. 

(2) The localized Weyl calculus for the representation tt along 9 is regular. 

Now let S = Si -j- S2 be any direct sum decomposition. If 1 < r < s < 00 and 
fi,T2,Si,S2 G [r, s] satisfy the equations + = 7^ ~^ 7^ " r^^s' then the 
cross- Wigner distribution defines a continuous sesquilinear map 

w(.,.): Mi\'^\n,e) X m;--(^,0) ^Af;^^(^^^^^)(^#,^? X 9). 
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Proof. First recall from Proposition 13.121 that the localized Weyl calculus for the 
representation tt along 9 defines a unitary operator Op* : — !• 62{'H)- 
Let /i, /2 G T-L-x and note that for every X G E we have 



{A;fh){X) = ih I 7^(exp,,(^^(J^)))02) = (^;'V2)(-X). (3.10) 
Therefore by Proposition 13. 151 we get 

l/s 



iim/i,/2)iiM;i=,^,,^,(.#,.x.) - (y F{Y,)dY,) ^ (3.11) 

where 

TO) = 1(11 i(^;f/i)(^i + n,^2 + i'2) 



-1 ■==■2 ^=-1 

X {AlU2)i~Xi,~X2)rdXidX2y^'dY,. 



(3.12) 



On the other hand, it follows by Minkowski's inequality that for every measurable 
function P : Si x S2 x S2 — C and every real number t > 1 we have 

(y |p(ri,X2,r2)|ciX2)*dri)'^* < j (^j \T{YuX2,Y2)HYiY'dX2 (3.i3) 

whenever 12 € ^2- By (|3.12D and (I3.13P with t := s/r and 

r(yi,X2,r2) := j \{Al'^ h){Y, - x^,Y2 - X2) ■ {A)f<i>2){x,,X2)Ydx^ 

we get 

F{Y2) <[j [j T{Y^,X2,Y2y'''dYiy''dX2y''^ 

= ||P(.,X2,y2)||L./.(H,)d^2)' 

Now note that r(-,X2;l2) is equal to the convolution product of the functions 
K-^^f /i)(-' ^2 - X2)r and |(^^^V2)(-, ^2)r- It follows by Young's inequality that 

||r(.,X2,y2)Lv..(Ho < lll(-^;;Vi)(.il.-^2)l1lLn(Holll(^;/'/'2) 

-||(-4jf/l)(-,>'2-X2)||l..,(.^)||(^;/</.2)(-,X2)||U(H,) 

whenever ti, t2 G [1, oo] satisfy + = 1 + ^. By using the above inequality with 
= ^ for j = 1, 2, and taking into account p.l4p . we get 

F{Y2) <[j ||(^;f/l)(-,>^2 -X2)||l.,(.^)||(^;/02)(-,X2)|IU(H,)d^2)'^'' 

^2 

=: e{Y2y/'-, 

(3.15) 



X (/ ll(^;/02)(-,X2)|rL-..(H,)d^2 
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where 9{-) is the convolution of the functions X2 Wi-^'^f fi){' , X2)\\^i^,-ti (^^^-^ and 
X2 ^ Wi-^'ff , X2)\\]^rt2 (^Z7^y It fohows by Young's inequality again that 

l/mi 



l/ni2 



provided that mi, 1122 G [1, 00] and ^ + = 1 + ^. For rrij = ^ , j — 1,2, we get 

II^'IIlV.-(H2) < (ll/l|lAf;i' = i('^,e))''(ll-^2||M^2-=2(^ 9))'^, 

where we also used (I3.10p . Then by (|3.1ip and (|3.15p we get 

I|W(/i,/2)||m--;^^ ,^^,(7r#,exe) < ll/ilL/^i-ic^.e) ' \\h\\M;i''^i^,e), 
and this concludes the proof. □ 

Corollary 3.17. Let 0i,(/>2 G T-Loo \ {0}, and assume the following hypotheses: 

(1) The representation tt satisfies both the density condition and the orthogo- 
nality relations along the linear mapping 0: S — >■ m. 

(2) The localized Weyl calculus for the representation tt along 9 is regular. 

Now let S = Si + S2 be any direct sum decomposition. If r, s, ri, Si,r2, S2 G [1, 00] 
satisfy the conditions 

r 1 ,1111 11 

T < s, r2, 32 G [r, s\, and = = 1 , 

ri r2 si S2 r s 

then for every symbol a 6 Af^*^^ 02)^'''*' ^ ^ ^) '^^ have a bounded linear operator 

Op'{a):M;i'^^in,9)^AQ'^^{n,e). 
Moreover, the linear mapping 

Op-- ^^wk,02)('^*'^ X ^) ^ S(M;--(7r,0),Af;--(7r,0)) 
is continuous. 

Proof. For every t e [l,oo] define t' £ [l,oo] by the equation 7 + p- = 1- With 
this notation, the hypothesis implies — + ^ — — + ^ = ^ + \ and moreover 

' ^ ^ ^ ri r2 si S2 r s 

ri,si,r'2,s'2 e ['''is']- Therefore we can apply Theorem 13. 161 to obtain 

whenever /i,/2 G H_oo- 

On the other hand, if a G M^^^^ ^^^(7r#,6' x 9), then 

(Op«(a)/i |/2) = (a| >V(/2,/i))l2(h-) 

= i-^W(0i,02)" I -^W(0i,02)('^^.^2'/l)))i^(HxH) 



where the first equality follows by p.4p . while the second equality can be proved 
by using Lemma I3.8tf2|) . Then Holder's inequality for mixed- norm spaces (see for 
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instance Lemma 11.1.2(b) in |Gr01j ) shows that 

|(Op^a)/i I h)\ < ||<£J^)a|U..(HxH) • Pw*(n.)(>V(/2,/i))IL.',.'(HxH) 

where the latter inequality follows by p.l6p . Now the assertion follows by a 
straightforward argument that uses the duality of the mixed-norm spaces (see 
Lemma 11.1.2(d) in [GrOl]). □ 

Corollary 3.18. Let 0i,02 G 'Hex \ {0}, and assume the following hypotheses: 

(1) The representation n satisfies both the density condition and the orthogo- 
nality relations along the linear mapping 9: S — > m. 

(2) The localized Weyl calculus for the representation tt along 9 is regular. 

Then for every a G M.J^J^^ <p2)^'^'^^ have Op^(a) G BiJ-L), and the linear mapping 
Op^ : M^'i^^^ ^^■^(■n'^,9 x 9) ^ B{H) is continuous. 

Proof. This is the special case of Corollary 13. 171 with with ri = si = r2 = §2 = 2, 
r = 1, and s = cxo, since Remark l3. 31 shows that Af^'^(7r, 9) —% for j — 1,2. □ 

Trace-class operators obtained by localized Weyl calculus. 

Lemma 3.19. Let the representation tt: Af — B{'H) satisfy the orthogonality rela- 
tions along the linear mapping 9: S — >■ m, and pick 4>o £ Hoc with \\(j)o\\ = 1. Then 
the following assertions hold: 

(1) The operator A^'^ : TL — > L^(S), / i— A^'^ f , is an isometry whose image is 
the reproducing kernel Hilbert space associated with the reproducing kernel 

K:ExE^C, K{X,,X2) = (7r(expj,,(^(Xi))),/)o | 7r(expj,,(^(X2)))./)o). 

The orthogonal projection from i^(S) onto Ran^^|^^ is just the integral 
operator defined by the integral kernel K . 

(2) For every (j), f £ Ti we have 

iAlff){X).7r{e^p,MXmdX = (<^ | 0o)/. 

In particular, for every f £% we have 

{Alff){X) ■ n{e^p,MXmo dX = f, (3.17) 

where the integral is weakly convergent in H. 
Assume that the representation tt satisfies the growth condition along 9. Also, 
assume that for every u G U(mc) the function ||d7^(^t)7^(expj^,J(^^(•)))0o || has poly- 
nomial growth, then moreover we have: 

(3) If f G Hoc, then the integral in (j3.17l) is convergent with respect to the 
topology ofHoa- 

(4) If f & H-oo, then p.l7p holds with the integral convergent in the w* - 
topology. 

(5) We have = {f e H-oo \ Alf f G S{E)}. 
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Proof. Assertion ([T]) follows at once by the orthogonality relations along with jFii05[ 
Prop. 2.12]. Then Assertion ^ follows by an apphcation of |Fu05| Prop. 2.11]. The 
proof for Assertions ([31)-® can be supplied by adapting the method of proof of 
|BB09c[ Cor. 2.9]. We omit the details. □ 

Remark 3.20. We note here that in the setting of Lemma I3.19[ the condition 
that for all u e U(mc) and (j) £ "^oo the function ||d7r(Adu(mc) (cxPm(^(0))^)'?^II 
has polynomial growth on S implies that for all / G H-oo, 4' £ ^oc, the function 
A^' f has polynomial growth as well. 

In fact, if / e "H-oo, then there exists u G U(mc) such that for every ip G Hoo 
we have |(/ | < ||d7r(w)-0||. (See Remark l2.1l ) Then we have 

= l(/ I He^PMmmi < ||d7r(u)7r(exp^(0(.))</')|| 
= ||d^(Adu(,ne)(expM(e(-)))«)'^ll 
and the latter function has polynomial growth by assumption. □ 

By using the method of proof of |BB09c[ Prop. 2.27] we can now obtain the 
following sufficient condition for a symbol to give rise to a trace-class operator. 

Proposition 3.21. Let 01,02 £ T^oo such that \\4>j\\ = 1 and for every u G U(mc) 
the function ||d7r(M)7r(exp^,f || has polynomial growth, for j = 1,2, and as- 

sume the following hypotheses: 

(1) The representation n satisfies both the density condition and the orthogo- 
nality relations along the linear mapping 6: S — > m. 

(2) The localized Weyl calculus for the representation tt along 9 is regular. 

Then for every a G M^f^^^ 02)^^'^' ^ ^ ^) ™^ have Op^(a) G &i{T-L), and the linear 
mapping 0]f : M^^^^^ ^^^{tt'^^O x 0) — > &i{'H) is continuous. 

Proof. It follows by Lemma r3.8t[ 2|). Lemma r3.9l[ 2l) and Remark 13.41 that the repre- 
sentation TT^^ : M K M — > satisfies both the orthogonality relations and 
the growth condition along the linear mapping 0x6':SxS^mixm. Moreover, 
it is easily seen that the function $0 '■= VV((/)i, 02) G has the property that 
for every u G U((m x m)c)) the norm of d7r'^(M)7r'^(exp^|^j^^((0 x 6')(-))))$o has 
polynomial growth on S x S, since a similar property has the rank-one operator 
Op^($o) = (• I 02)01 G &2{'H) with respect to the representation tt'^, as a direct 
consequence of the calculation (|3.19l) below. Therefore we can use Lemma I3.19t l4)) 
for the representation tt'^ to see that for arbitrary a G 5'(S*) we have 

a = JJ{Al*/'''a){X,Y)-n*{exp^,^^MX),9{YmodXdY, 

whence by (\3.6\i we get 
Op-(a) = |y'(^j7^^)(X,y).Op«(^#(exp,,f,M(^?(^),^?(5")))<fo)dXdy (3.18) 

where the latter integral is weakly convergent in jC{'H 00, 'H-oo) (— jC {H-oo, 'Hoo)' by 
Proposition 12 .5tf 2|) ) . On the other hand, for arbitrary X,Y E E we get by Remarks 
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IXTilandlXm 

= niexpMiOiX) + 0(Y))) o Op«($o) o 7r(expM(0(X)))-i 
= (• I TT{expM{e{X)))(t>2MexpM{e{X + ¥)))<!>,. (3.19) 

In particular, Op^(7r#(expA,^^j,,f (6'(X), 6'(r)))$o) £ and 

||Op^(^#(expM.M(^(^),^^(>^)))<fo)||i 

- ||^(exp^,(0(X + r)))0il| • ||7r(exp^,((?(X)))02|| 
^ 1. 

It then follows that the integral in p.l8p is absolutely convergent in (3i(?^) for 
a £ (''■'^ ,0x6) and moreover we have 

||Op«(a)||i< II \{Al*/'''a)iX,Y)\dXdY=\\a\\,,..^^^ ,^,^ 

which concludes the proof. □ 

4. Applications to the magnetic Weyl calculus 

We proved in [ BB09aj that the magnetic Weyl calculus on ]R" constructed in 
[MP04j can be alternatively described as the localized Weyl calculus for a suitable 
representation. This point of view actually allowed us to construct magnetic Weyl 
calculi on any simply connected nilpotent Lie group G, by using an appropriate 
representation tt: AI — T x G B[L?{G)) and linear mappings 9^ : q x q* m. 

We shall see in the present section that all of the conditions studied in Sections 
[2] and [3] are met by tt and 9^ (see CoroUar v 14 . 71 below) . provided the coefhcients of 
the magnetic potential A £ ri^(G) have polynomial growth. Therefore, the abstract 
results of the previous sections can be used for obtaining continuity and nuclearity 
properties for the magnetic Weyl calculus (see Corollaries I4.81l¥. 101 below) . 

Notation 4.1. For any Lie group G we denote by A: G — > End (C°°(G)), g Ag, 
the left regular representation defined by {\g4>){x) ~ (j){g^^x) for every x, g G G and 
<j> G C°°(G). Moreover, we denote by 1 the constant function which is identically 
equal to 1 on G. (This should not be confused with the unit element of G, which 
is denoted in the same way.) □ 

We now recall the following notion from |BB09aj . 

Definition 4.2. Let G be a finite-dimensional Lie group. A linear space of real 
functions on G is said to be admissible if it is endowed with a sequentially complete, 
locally convex topology and satisfies the following conditions: 

(1) The linear space J- is invariant under the representation of G by left trans- 
lations, that is, a (j) £ T and g £ G then Xg4> £ T . 

(2) We have a continuous inclusion mapping T ^ C°^(G). 

(3) The mapping G x F ^ [g^cj)) ^ Xgcj) is smooth. For every (j) £ F we 
denote by X{-)(j): q T the differential of the mapping 5 i— ;> Ag(/) at the 
point 1 G G. 

(4) For every 52 £ G with g\ ^ 52 there exists 4> £ F with 4>{gi) ^ <t>{g2)- 

(5) We have {^^ | (/) e J"} T*G for every g£G. 
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For instance, the function space C^{G) is admissible. □ 

Proposition 4.3. Let G be a finite- dimensional simply connected nilpotent Lie 
group with the inverse of the exponential map denoted by log^ : G q. If we 
define 

J-G :=span„({A3(eo logo) Ue0*,geG}), (4.1) 
then the following assertions hold: 

(1) J-Q is a finite dimensional linear subspace of C°°{G) which is invariant 
under the left regular representation and contains the constant functions. 

(2) The semi-direct product Mq := J-q xia G is a finite- dimensional simply 
connected nilpotent Lie group. 

Proof. Since G is a simply connected nilpotent Lie group, we may assume that 
G-(0,*). 

([l} It is clear that the linear space J-q is invariant under the left regular repre- 
sentation. On the other hand, for every V,XGq and ^ G g* we have 

{XvOix) = (e, {'V) *X) = {(,-V + X + ^[-V, X] + ---). 

Thus, if we denote by N the nilpotency index of g, then we see that J-q consists 
of polynomial functions on g of degree < N, hence dim < oo- Moreover, if 3 
denotes the center of g and we pick V £ ^ and ^ & g* , then Ay^ — — F)l + ^. 
We thus see that the constant functions belong to J-q- 

^ On the Lie algebra level we have mo := J-g and both J^g and g are 

nilpotent Lie algebras. Therefore Engel's theorem shows that, for proving that 
mo is nilpotent, it is enough to check that the adjoint action admo gives a rep- 
resentation of g on J-Q by nilpotent endomorphisms. This representation is just 
A: g — > End (J-q) hence, by the theorem on weight space decompositions for rep- 
resentations of nilpotent Lie algebras (see for instance |Ca051 Th. 2.9]), it suffices 
to prove the following fact: If a £ g*, (f) £ J-q \ {0}, and for every X £ q we have 
X{X)(j) = a(X)0, then a = 0. 

To this end, let Xq £ g arbitrary. Since A(Xo)(/) = a(Xo)0, it follows that for 
every Y £ g and t £ R we have 4'{{—tXo) — e*"'^^'^)(/)(F). We have seen above 
that Tq consists of polynomial functions on g of degree < N, therefore for every 
Y £ Q there exists a constant G^^y > such that 

(VteM) e*"(^«'|0(y)| = m~tXo) *Y)\ < C^^y{1 + \t\)^' . 

On the other hand, since (p G \ {0}, there exists Y £ g such that (piY) ^ 0, and 
then the above inequality shows that a{Xo) — 0. This holds for arbitrary Xq £ g, 
hence a = 0, as we wished for. □ 

Theorem 4.4. Let G be a finite- dimensional simply connected nilpotent Lie group 
with an admissible function space T such that there exist the continuous inclusion 
maps g* ^ 7^ 7- C^j(G), where the embedding g* '-^ J- is given by ^ 1-^ ^ o logg. 
Denote M = J- xix G, fix e G M \ {0}, and consider the unitary representation 
tt: M B{L^{G)), 7r(0,g)/ = e'^-^Ag/ for all (/) £ T, g £ G, and f £ L'^[G). 
Then tt is a nuclearly smooth representation and its space of smooth vectors is the 
Schwartz space S{G). 
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Proof. Let us denote H = L'^{G) and let Hoc be the space of smooth vectors for 
the representation tt. We first check that S{G) = Hoo- 

For proving that S{G) C Hoo, let / G S{G) arbitrary. Since T ^ C^^iiG)^ 
follows at once that for every (j) G T and g G we have tt{(I>, •)/ G C°°{G,'H) and 
7r(-,5)/ 6 C°°{T,n). It then follows by [NeOTl Sect. I] (see also [Ha82l Th. 3.4.3]) 
that 7r(-)/ e C°°{M,n), hence / 6 ?^oo- 

To prove the converse inclusion S{G) C we need the function space 
defined in (|4.ip . Since J' contains o log^, | ^ G g*} and is invariant under the 
left regular representation of G, we get J^g ^ ^- Now Proposition 14.31 shows that 
Mq := J-G X G is a finite-dimensional nilpotent Lie group. Since g* ^ J-g, it is 
easily seen that the unitary representation ttq :— t:\i\i„ : Mq — B{H) is irreducible. 
Let Hoo.TTo be its space of smooth vectors. If 6i : C°°{G) — > C is the Dirac distri- 
bution at 1 G G, then the discussion in BB09a, subsect. 2.4] shows that Tg x {0} 
is a polarization for the functional {Si\jr^,0) G mg, and the corresponding induced 
representation is just ttq. Now Hoo,7ro = 5(G) by f CGP77[ Cor. to Th. 3.1]. There- 
fore we get the continuous inclusion Hoo ^ '5(G), which completes the proof for 
the equality 5(G) = Hoo- 

Furthermore, it easily follows by |CG90| Cor. A. 2.4] that Hoo = S{G) = 5(g) as 
locally convex spaces. On the other hand, it is well known that 5(g) is a nuclear 
Frechet space; see for instance |Tr67| . Finally, both mappings M x 5(G) — > 5(G), 
{m,(j)) I— !> 7r(m)(/>, and m x 5(G) — !> 5(G), (X, 0) i—^ d7r(X)0 are continuous as a 
direct consequence of [CG90, Th. A. 2. 6], and this concludes the proof of the fact 
that TT is a nuclearly smooth representation. □ 

We now prove that the conclusion of Theorem 14.41 actually holds under a much 
stronger form. 

Corollary 4.5. In the setting of Theorem \4.4\ the unitary representation tt is twice 
nuclearly smooth. 

Proof. The proof has two stages. For the sake of simplicity we assume e — 1, 
however it is clear that the following reasonings carry over to the general case. 

1° We first make the following remark: For j — 1,2, let Gj be a finite-dimensional 
simply connected nilpotent Lie group with an admissible function space such 
that g* ^ J^j ^ C^i(Gj) as in Theorem lOl Also define the group M, = J'j >i\Gj 

and the unitary representation tt^ : Mj — > B{L^{Gj)), nj{(j),g)f — e'^"^)^ ^'^^gf 
for all (j> G Tj, g G Gj, and / G L?'{Gj). Now consider the direct product group 
Go := Gi X G2, the function space 

J-Q (J-i ® 1) + (1 ® T2) C^i(Go), 

and the representation ttq : Mq — > B{L'^{Go)), no{(j),g)f — e^'^Xgf for all G J^o, 
g G Go, and / G L^(Go), where Mq := J"o XaGo. Then J^q is an admissible function 
space on Go and there exists a 1-dimensional central subgroup N C Mi x M2 
such that TV C Ker (tti (g) 112), and we have Mq = (Mi x M2)/N. Moreover, the 
representation -kq is equal to tti ® 1:2 factorized modulo N . 
In fact, let us define the linear map 

A: J"i X ^ -7^0, ((/)i, (/)2) ^ (/-i 1 - 1 ® 02- 

Then Ran A = Tq and Ker A = {(tl,il) | t G M} ~ M, hence we get a linear 
isomorphism Fq ~ {Ti x J2)/Ker A, and this can be used to define the topology 
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of Fq. Moreover, it is clear that Ker A is contained in the center of mi x m2 — rno 
and Ker A C Ker (d(7ri(8)7r2)), hence the above remark holds for N = cxp^ij^.^ (Ker A). 

2° We now come back to the proof of the corollary. We already know from 
Theorem 14.41 that the representation tt is nuclearly smooth. Moreover, by using 
the remark of stage 1° for Gi — G2 — G along with Theorem 14.41 for the group 
G X G, we easily see that the space of smooth vectors for the representation tt (K) tt 
is linear and topologically isomorphic to S{G x G), which in turn is isomorphic 
to S{G)(E)S{G) (see for instance |Tr67| ). On the other hand, S{G) is the space of 
smooth vectors for tt, by Theorem 14.41 Thus the representation tt also satisfies the 
second condition in the definition of a twice nuclearly smooth representation (see 
Definition 12. 2p . and we are done. □ 

Notation 4.6. Let G be any Lie group with the Lie algebra q and with the space of 
globally defined smooth vector fields (that is, global sections in its tangent bundle) 
denoted by X{G) and the space of globally defined smooth 1-forms (that is, global 
sections in its cotangent bundle) denoted by ft^{G). Then there exists a natural 
bilinear map 

(•,•): n\G) X X(G) ^C°°(G) 

defined as usually by evaluations at every point of G. 

Moreover, for arbitrary (7 G G, we denote the corresponding right-translation 
mapping by Rg : G ^ G, h ^ hg. Then we define the injective linear mapping 

6^: fl^X(G) 

by {i^X){g) = {Ti{Rg))X e TgG for all g e G and X e Q. □ 

Corollary 4.7. Assume the setting of Theorem \4-4\ If we have A G il^{G) such 
that {A, X) £ J- whenever X E q, then we define the linear mapping 

9^: gxQ* ^m = TK^g, (X, ^ (C o log^ +{A, J^X),X). 

Then for every e G M \ {0} the representation tt^ : AI — > B{L^{G)) has the following 
properties: 

(1) The representation Tr^ satisfies the orthogonality relations along the map- 
ping 9^. 

(2) The representation Tr^ satisfies the growth condition along 9^. 

(3) The localized Weyl calculus for tTj along 9^ is regular and defines a unitary 
operator Op^'* : L^{g x g*) ^ 62(i2(G)). 

(4) Ifue U(mc) and (p G S{G), the function ||d7r(Adu(mp)(exp^,j(0'^(-)))M)(?!)|| 
has polynomial growth on q x q* . 

Proof. Throughout the proof we assume e ~ 1 and we denote tti — t: for the sake 
of simplicity. The case of an arbitrary e G M \ {0} can be handled by a similar 
method. Since G is simply connected, we may assume G = (g, *). Then the space 
of smooth vectors for tt^ is equal to S{g) by Theorem 14.41 
(P) The assertion follows by |BB10a( Th. 2.8(1)]. 

([2|) To check the growth condition p.2|) we shall denote for every X € 2, 

1 
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and also 

1 

TA{X,Y)=exp(i J {A,i'''X){{-sX)*Y)ds) 



for X,Y eQ. It then follows by [BBlOai Prop. 2.9(1)] that for every /, e S{g) we 
have 

{A;'''f)iX,0 = / e'^^-^^TAiX, -^l,\Y))fi-^-^\Ymi-X) * i-^],\Y))) dV. 

Therefore the function A^' f'QXQ* ^ C is a partial inverse Fourier transform 
of the function defined on g x g by 

(X, Y) ^ TAiX, -^^'{Y))fi-^^\Ymi-X) * : fl ^ C. 

On the other hand, it was noted in the proof of [BBOQal Th. 4.4(4)] that each of 
the mappings I]i,S2:0X0^-gxg are defined by 

Ei(y,z) = (-y,y*(-z)) and j:2{v,w) ^ {~^w{v),w). 

is a polynomial diffeomorphisms whose inverse is a polynomial. Since 

j:^\y,x) = {^i,\-y),x) 

and TA e C^[(0 X g), it then easily follows by |CG90[ Lemma A. 2. 1(a)] that we 
have a well-defined continuous sesquilinear mapping 

5(0) X 5(0) ^5(0X0*), {/,<!>) ^Al'""/. 

Thus the representation tt satisfies the growth condition along the mapping 9^. 
© Use the above Assertion ^ along with |BB09a[ Th. 4.4(4)]. 
(jH The assertion follows as a direct consequence of |BB10a| Lemma 2.5]. □ 

In the next corollaries we denote by tt the representation Tr^ in Theorem 14.41 for 
e — \. Recall that we work with a finite-dimensional simply connected nilpotent Lie 
group G with an admissible function space J- such that there exist the continuous 
inclusion maps 0* ^ J" ^ C^[(G), where the embedding 0* ^ J" is given by 
f ^ ^ologg. Moreover M = J^xi\G, and the aforementioned unitary representation 
tt: M -> B{L^{G)) is defined by 7r((/),5)/ = e'^Xgf for all (p € T, g € G, and 
feL^iG). 

If we have A G ft^{G) such that (A, l^X) G whenever A" G 0, and we define 
the linear mapping 

e^: 2X2* ^m^TK^g, (A,C) ^ (^ o log^ /,« A), A) 

as in Corollarv l4.7l then one can consider the modulation spaces of symbols for the 
localized Weyl calculus for the representation tt along the linear mapping 9^. These 
are just the modulation spaces for the representation tt^ : M x M B{L^{g x g*)) 
with respect to the linear mapping {9^,9"^): (0 x 0*) x (0 x g*) — > m x m. It 
follows by Remark [3.141 that for arbitrary $ G S{g x 0*) and F G S'{g x g*) the 

corresponding ambiguity function A^ ' i^: (g x g*) x (0 x 0*) — > C is given 
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by the formula 



^^)((^i, a), (^2,6)) 



(^#(expM,M(^^(^i,a),^?^(^2,6))^^ I ^)LHr^,') 
(•gi(-,(Xi+X2,6+«2))_^e-*^^e^g-i(-,(Xi,Ci)>^)^ 



0X8* 

where #® stands for the Moyal product on g x g* defined by means of the magnetic 
potential A. For r,s G [1, oo] and the window function $ e S{g x g*) we have the 
modulation space of symbols 

M'^\7r*,0^ X 9^) ^{Fe S'{3 x g*) | Af F e L^'^ig x g*) x (g x g*))}. 

Corollary 4.8. In the above setting, pick (j)i, (1)2 G iS(G')\{0}. If r, s,ri, si,r2, S2 G 
[l,oo] satisfy the conditions 

r 1 , 1111 11 

r < s, r2,S2e[r,s\, and = = 1 , 

ri r2 si S2 r s 

then for every symbol a G AI^^^^ ('t'^, 0^ x 9"^) we have a bounded linear operator 

Moreover, the linear mapping 

Ov''':Ml;,\^^^^^^{^*,9^ X 9^) ^ B{MI\'^^{^,9%M;1'^^{^,9^)) 
is continuous. 



Proof. It follows by Theorem l4.4l that the space of smooth vectors for the represen- 
tation TT is the Schwartz space S{G). Moreover, Corollary 14.71 shows that we can 
apply CoroUarv 13.171 for the representation tt. Now the conclusion follows by using 
the latter corollary. □ 



Corollary 4.9. Assume the setting of Corollary \4.7\ let (f>i,(f>2 G S{G) \ {0}, and 
r, s G [l,oo] such that i + ^ = 1. Then for every a G M^^^^ ^^^{tt'^,9^ x 9^) we 

have Op^^ia) G B{L^{G)). Moreover, Op^^ : MI^'^^^^^^^{tt* ,9"^ x 9^) B{L^{G)) 
is a continuous linear mapping. 

Proof. This is the special case of Corollarv 14.81 with with ri = si = r2 = S2 = 2, 
since Remark shows that M'^fin, 9^) = L'^{G) for j = 1,2. □ 

Corollary 4.10. Assume the setting of Corollary \4. 7| and let (j)i,(j)2 G S{G) \ {0}. 
Then for every a G M^^^^^ ^^^{tt*,9^ x 9^) we have Op'^ (a) G ei{L^{G)), and the 

linear mapping Op^ : M^^^^ ^^^{tt'^,9^ x 9^) — > 6i(L^(G)) is continuous. 

Proof. Recall from Theorem 14.41 that the space of smooth vectors for the represen- 
tation TT is the Schwartz space S{G). Moreover, Corollarv 14.71 shows that we can 
use Proposition 13.211 and the conclusion follows. □ 

Remark 4.11. In the special case when G is the abelian group (R",-|-) and we 
have the magnetic potential A G r2^(K"), the magnetic Weyl calculus 

Op*''" : 5'(R" X (R")*) ^ £{S{W"),S'{W")) 
is just the one constructed in |MP04j . In this setting, we note the following: 
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(1) In the case when the coefficients of the magnetic field B := dA G il^(M") 
belong to the Frechet space BC°°(R") of smooth fmictions on M" which 
are bounded along with all of their partial derivatives, one established in 
[IMP07j some sufhcient conditions on a symbol a G x (E")*) that 

ensure that the magnetic pseudo-differential operator Op (a) is bounded 
on L^(R"'). In this connection, we note that the previous Corollary 14.91 
provides another type of sufficient conditions for L^-boundedness when the 
coefficients of the magnetic field B belong to the larger LF-space C^[(K") of 
smooth functions on R" that grow polynomially together with their partial 
derivatives of arbitrary order. This follows since for every closed 2-form 
B € r2^(K") whose coefficients belong to C^[(M"), one can construct in the 
usual way a 1-form A e ri^(]R") whose coefficients belong to C^[(R") again 
such that dA = B. 

(2) It follows by the comments preceding Corollary 14.81 that the modulation 
spaces of symbols M"^" {tt'^ , 9^ x 9^) can be alternatively described in terms 
of the modulation mapping which was introduced in |MP09| in the case of 
the abelian group G = (R", +) by using the magnetic Moyal product 

It had been already noted in |MP04| that the magnetic Moyal product on 
(M", +) actually depends only on the magnetic field B = dA. This assertion 
holds true for the two-step nilpotent Lie groups, as an easy consequence of 
the formula established in Th. 4.7 in |BB09a| . 

□ 
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